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Abstract 

The explicit solution of the discrete time filtering problems with 
exponential criteria for a general Gaussian signal is obtained through 
an approach based on a conditional Cameron-Martin type formula. 
This key formula is derived for conditional expectations of exponen- 
tials of some quadratic forms of Gaussian sequences. The formula 
involves conditional expectations and conditional covariances in some 
auxiliary optimal risk-neutral filtering problem which is used in the 
proof. Closed form recursions of Volterra type for these ingredients 
are provided. Particular cases for which the results can be further 
elaborated are investigated. 
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1 Introduction 

The linear exponential Gaussian (LEG for short) filtering problem, i.e., with 
an exponential cost criteria (see the definition ([6]) below), and the so called 
risk-sensitive (RS for short) filtering problem (see [5] and the statement (15^ 
below) have been given a great deal of interest over the last decades. Numer- 
ous results have been already reported in specific models, specially around 
Markov models, but, as far as we know, without exhibiting the relationship 
between these two problems. See, e.g., Whittle [I6]-[T7], Speyer et al. [T5] . 
Elliott et al. [2], [5], [7] and Bensoussan and van Schuppen [1] for contri- 
butions on this subject and related LEG and RS control problems. Therein 
the notion of "information state" has been introduced without any clear 
probabilistic meaning for auxiliary processes which are involved, even in the 
Gauss-Markov case. Moreover, the method proposed in [2] does not work 
in a non Markovian situation. In our paper [10], we have solved the LEG 
and RS filtering problems for general Gaussian signal processes in continuous 
time and in the particular setting where the functional in the exponential is 
a singular quadratic functional. Moreover we have proved that actually in 
this case the solutions coincide. In our paper ^1] we have solved the LEG 
and RS filtering problems for Gauss-Markov processes but with a nonsingu- 
lar quadratic functional in the exponential. In this setting we have proposed 
an example to show that the solutions may be different. On the other hand, 
the general solution for the optimal risk-neutral linear filtering problem and 
a Cameron-Martin type formula for general Gaussian sequences have been 
obtained in [9J. It seems natural to use the approach proposed in |9j and 
[TU] to derive the solution of the LEG and RS filtering problems for general 
Gaussian signals in discrete time setting, to precise their link and also to give 
a probabilistic interpretation for the ingredients of the "information state" . 

In the present paper we are interested in the explicit solution of the Linear 
Exponential Gaussian (LEG) and Risk Sensitive (RS) filtering problems for 
general Gaussian signals. Namely we deal with a signal-observation model 
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{Xt, Yt)t>i, where the signal X = {Xt)t>i is an arbitrary Gaussian sequence 
with mean m = {mt,t > 1) and covariance K = {K{t, s),t > 1, s > 1), i.e., 

W.Xt = mt, lE{Xt-mt){Xs-ms) =K{t,s), t>l,s>l, 

and, for some sequence A = {At, t > 1) of the real numbers, the observation 
process Y = {Yt, t > 1) is given by 



where e = {et)t>i is a sequence of i.i.d. A/'(0, 1) random variables and e and 
X are independent. 

Suppose that only Y is observed and for a given real number fi and a 
fixed sequence {Qt)t>i of nonnegative real numbers, one wishes to minimize 
with respect to h : ht & yt,t > 1 the quantity: 



where (3^*) is the natural filtration of Y, i.e., 3^t = a{{Yu, 1 < u < t}) and 
ht G yt means that ht is 3^t-measurable. 

Note that, according to the sign of the real parameter fi, there are two dif- 
ferent cases for this linear exponential Gaussian (LEG) filtering problem (the 
terminology is taken from the linear exponential Gaussian optimal control 
problem) : 

• /i < 0, called risk-preferring filtering problem, 

• fi > 0, called the risk-averse filtering problem. 

It is well known (see, e.g., [15] for the Markov case) that the solution to 
this problem is not the conditional expectation of Xt given the cr-field yt. 
Our first aim is to show that the solution can be completely explicited : the 
characteristics of the optimal solution are obtained as the solution of a closed 
form system of Volterra type equations which actually reduce to the equations 
known also for the RS setting when the signal process X is Gauss-Markov 
(see, e.g., IHj). Our second aim is to give the probabilistic interpretation of 
this optimal solution in terms of an auxiliary risk-neutral filtering problem. 
Actually, we extend the filtering approach initiated in [9] and [10] for one- 
dimensional processes, to obtain a conditional Cameron-Martin type formula 



Yt = AtXt + St, 



(1) 
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for the conditional Laplace transform of a quadratic functional of the involved 
process. Namely, we give an explicit representation for the random variable 



where hg G 3^s, s > 1. 

The paper is organized as follows. In Section [2] we derive the solution of 
the LEG filtering problem : explicit recursive equations, involving the covari- 
ance function of the filtered process, are obtained. In particular, in Section 
12.11 an appropriate auxiliary risk-neutral filtering problem is matched to that 
of deriving the key Cameron-Martin type formula. The solution of this aux- 
iliary filtering problem is discussed in Section [2l2l In Section [3] we investigate 
some specific cases where the results can be further elaborated. In Section H] 
we discuss the relationship between LEG and RS filtering problems. Section [S] 
is devoted to the interpretation for the ingredients of the "information state" . 
Finally, Sections [HI and [7] are devoted to a more general case, namely when 
the particular structure of the observation sequences {Yt)t>i is not specified. 

2 Solution of the LEG filtering problem 

Let us introduce the following condition (C^): 
(Cfj) the equation 



has a unique and bounded solution on {(t, s) : 1 < s < t < T}, such 
that 7; = 7(/, /) > 0, / > 1 and moreover 



Remark 1. Notice that for all fi negative the condition (C^) is satisfied 
and if fi is positive, the condition {C^) is satisfied for fi sufficiently small, 
for example, those such that for any t <T — fiQt is nonnegative. 

The first result is the following 






s-l 



1 + ^,7^ > 0, / > 1. 
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Theorem 1. Suppose that the condition (C^) is satisfied. Let {ht)t>i he the 
solution of the following equation: 



ht = mt + ^Aa{t,l){Yi - Aihi), 
1=1 

where 7 = (7(t, s),l < s <t <T) is the unique solution of equation 
Then {ht)t>i is the solution of the LEG filtering problem, i.e., 



(5) 



h = argmin E exp 

h:ht£yt,t>l 



t=i 



Moreover, the corresponding optimal risk is given by 



Efiexp\^J2^X,-htfQt \ = fill 



t=i 



1 + Sg, 



'1/2 



(6) 



Theorem [T] is a direct consequence of resuhs of Section I2.1[ Its proof wiU 
be given at the end of Section I2.1[ 

Remark 2. • Note that equation ([5]) is really recursive equation and it 
can be rewritten in the equivalent form: 



1 



1 + A'Ti 



t-i 

mt + Y, ^nit, IWi - Alhi) + At%Yt 
1=1 



It is worth emphasizing that taking fi = in equation one gets 
through equation ^ the solution h of the risk-neutral filtering problem 
of the signal X given the observation Y, i.e., ht = E{Xt/yt) (see, e.g.. 



2.1 Conditional version of a Cameron-Martin formula 

The proof of Theorem [1] is based on the conditional version of the Cameron- 
Martin formula which provides the conditional expectation Xt defined by ([3]). 
Let 
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Then Xt = TTt{Jt), where for any random variable t] such that E|?7| < +00, the 
notation 7Ct{ri) is used for the conditional expectation of t] given the cr-field 
yt = cr{{Ys,l<s<t}), 

Proposition 2. Suppose that the condition (C^) is satisfied. Let {^{t, s), 1 < 
s < t < T) be the solution of equation (j3]) and {Zj^, t > 1) be the solution of 
the following equation 



t-1 



1=1 ' ''^ 1=1 '■'^^ 

Then the following representation of the random variable Xt defined by ([3]) 
holds for any T > 1: 



t-1 



Ai 



Xt 



n 

t=i 



1 + St-f, 
1 + AH 



ht 



Z^ + Aa,Y, 

1 + AH 



where (A^T)r>i is a martingale defined by 

T 



Ml 



n 



t=i 



\iX + Aht)] 


1/2 . 


exp < 


[ l + AHt \ 



2^ y^t 



1 + AH 



(9) 



■nt-i[Xt))vt- 

A\{lt-l,)-vl 
2 \^AH'^' '^^-^K^^^n 2 (1 + A?7j(l + Ah0 

in terms of the innovation sequence {i't)t>i' 

vt = Yt- At-Kt^^iXt)- n-iiXt) = nxt/yt-i), 

and of the variances of one-step prediction errors {■yt)t>i-' 

7t = E(Xi-7ri_i(Xi))2. 

Remark 3. 1. The probabilistic interpretation of the auxiliary processes 
{Z^) and (7f)t>i appearing in the PropositionlE will be clarified below. 

2. Proposition IE reduces to the ordinary Cameron- Martin type formula 
(cf. Theorem 1 J9^) for h = when At = 0, I > 1 and hence X and Y 
are independent. 



6 



Proof of Proposition [2] We will prove Proposition [2] for /i < 0, namely 
/i = — 1. Then we can replace Q by —^Q and the statement of Proposition [2] 
is still valid because of the analytical properties of the involved functions. 

The proof of Proposition [2] for = — 1 will be separated into two steps. 

I. (Actually it is the discrete time analog for the general filtering theorem.) 
Since /ij G 3^*, t > 1, in the proof we can suppose that /i is a deterministic 
function. First of all, we claim that for J^, defined by ([7]) 



MJt) 



where (3^ = eM^X^y - ^AX^). 

Indeed, let us introduce the new probability measure P, defined by 

^ = expi-AtXtet--A'^X^). 



(10) 



The classical Bayes formula gives that 



ntiexpiAXtSt+'^A^XD) 7ri(exp(AXiFt - i^^Xf)) ' 

where 7it{-) denotes a conditional expectation with respect to yt under P. 
Note that under P the distribution of {Xg, Yr)s<t,r<t-i is the same as under 
P and Yt is a M{0, 1) random variable independent of (X^, Yr)s<t,r<t-i ■ 
To understand this point it is sufficient to write the following equality for 
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the mutual characteristic function with arbitrary real numbers {aj, Xj): 



t t-i 



= Eexp i 2 ^ ajXj + i ^ XjYj + tXtYt - AtXtSt - l^t^t 
[ j=i j=i 

= e(e exp |z J2 ^3^3 + ^ 5Z ^3^3 + i^tYt - AtXtEt - ^A^^t^j j 

( t t 1 ^ ^ ^ 

= Eexp <^ i ^ a^Xj + z ^ XjYj + iAtA^Xt - -A^X^ + -{iXt - AtXtf \ -- 
I i=i j=i J 

f * 1 

= e's-^* E exp < i ^ a^-Xj + i ^ AjY,- > , 

I j=i i=i J 

where Xt is the a-field Xt = a{{Xs , 1 < s < t}). Hence, 

7rt{Jtexp{AtXtYt - ^A^X^)) = 

= 7it_i{Jtexp{AtXty - ^A'^X^))\y=Y, = 

Similarly, 



y=Yt ' 



and hence ( ITOi) holds. 



II. In the second step we will calculate the ratio which, due to ([10 
can be rewritten as 



1t-i TTt-iiJt-i) 7rt_i(Jt_i)7rt_i(/3f) 



(11) 

y=Yt 



For this aim similarly to what we proposed in |9] and [TO] we introduce 
the auxihary processes (F/)j>i and {^t)t>i- Let e = {et)t>i be a sequence of 
i.i.d. J\f{0, 1) random variables independent of X and define (Y^,^t)t>i by: 

Y,^ = Qt{Xt-ht) + ,/Qtet, (12) 
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6 = - h,)Y^'. 



(13) 



Now the following equality holds: 



7rt-i(Jt-i) 



7fi_i(exp{-iQ,(Xi - htf - 6-i}/3r) 



y=yt 



7ri_i(exp(-^t_i)) 



y=yt 



where vff(-) stands for a conditional expectation w.r.t. to the cr-field J't = 
(j({Fs, F/, s < t}) under the initial measure P. 

Again the proof of this equality is based on the Bayes formula. Namely, 
let P be the new probability measure defined by 



dP 
rfP 



Pt-i = exp 



t-i t-i 



(14) 



Then JtPt-i = exp{-^t„i - jQtiXt - htf} and Jt-iPt~i = exp{-^t_i}. 
Thus 

7rt_,{exp{-^t-lQt{Xt-htf)P!) 



7rt_i(exp(-^t_i)) 

E(JiAVt-iM-i) 



y=Yt 

Eipt-i/yt-i) 



E{pt-i/yt-i) Eexp(Jt_iPi_i)/X_i) 

E{Jtf3^/yt-i) 



t{Jt-i/yt-i 



y=Yt 



y=yt 



y=Yt 



where the last equality holds because under the probability measure P the 
distribution of (X^, Ys)s<t is the same as under the initial measure P and 
{Xs,Ys)s<t-i is independent of {Y^)s<t^i. 



Finally we have proved the following: 

MJt) _ 7fj_i(exp [-^t-i + AXtV - ^QtiXt - ht 



\AlXj]\ 



Tit-i{Jt-i) 7rt_i(exp(-^t_i))7rt_i(/3j^) 

y=Yt 
(15) 

At this point we will use the conditionally Gaussian properties of {Xt,^t-i) 
w.r.t. yt-i and Lemma 11.6 [12] which says that for a Gaussian pair (f/, V) 
with mean values m^.rriy, variances 7[,,7^ and covariance 7^^^ 
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Eexp <^ --DU^ + Aif/ -\^V\ = {1 + D7, 



v-l/2 



X 



D 



X exp { —Xomy H — ^7,, ■ 



^?7c/ +2Ai(m^ - A27 



(16) 



for any real numbers Ai,A2 and D > 0. Indeed, in (1151) we will apply this 
formula to {U, V) = {Xt,C,t-i) given yt~i with 

D = St = Qt + Al A2 = 1, Ai = Aty + Qth, 

in the numerator and D = Xi = 0, A2 = lin the first factor of the denom- 
inator and again to {U, V) = {Xt,C,t-i) given yt-i with 

D = Al A2 = 0, Ai = Ay, 

in the second factor of the denominator. 

Collecting the terms as coefficients for and hf, we obtain that 



It (1 + ^^7*) 



^.^-1/2 



xexp 



■ exp 



Qt 1 + A^lt 
2 1 + ^,7, 



— n 2 



Z^ + Aa,Y t 
1 + AH 



X 



Aj{Z^y-AHY,\ YtZ'lM ^\ A\i^U{^,)-2A,i,,^^{X,)Y,~A\Yh, 



2(1 + A'7j 



1 + A'7t 2 



1 + ^ht 



where = nt^i{Xt) - l^^it) with 



7,^(t) = E[(Xi - 7fi_i(Xi))(6-i -7fi_i(et-i))M-i], t > 2; 7,,(1) = 0. 



(17) 



To finish the proof we just replace Yf by + AtTrt_i{Xt) . Thus in the last 
exponential term we find: 



exp 



^M?(7*-7t) 



Zf-7r,_i(X,) 



2(1 + ^^7^(1+ Ah*) 



1 + AH 



which gives the Proposition. 
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Remark 4. 1. Note that now the probabilistic interpretation of the ingre- 
dients 7j and is clarified for negative fi. Namely, 7^ = K{Xt — 
Wt_i{Xt)Y , and = 7ft_i(Xj) — 7^^(t), but when fi is positive, there 
is no such connection anymore. 

2. Observe that actually 7ft-i{Xt) and^^^it) are yt-i-measurable, but the 
difference Z^ = Wt_i{Xt) ~lj^^{t) is yt-i measurable. 

Proof of Theorem [T] The statement of Theorem [T] is the direct conse- 
quence of Proposition I2.1[ Indeed, we claim that the foUowing chain of 
inequahties holds for any h : ht & yt,t > 1 : 



t=i 



E 



1 + Sg, 



t=i 

T 



E/x expK^(X,-M2g, / yj 



t=l 



-1/2 



xexp <^ ^Qt- X 



>n 

i=l 1- 



1 + St% 



^ -\ -1/2 



(b) 



1 + ^?7t 
T 



t=i 



/iEA^T 

-I , r. — n -1/2 

^ + Aht. 



Of course under condition (C^), since the term in the last line is finite, it is 
sufficient to consider the case: 



E/iexp<^ ^Y^{Xt - htfQt \ < 00, 



(18) 



t=i 



which gives the first equality. Inequality (a) follows directly from Propo- 
sition 12.11 Equality (6) is a direct consequence of (fT6l) which gives that 
EA^t = 1- Now, to obtain the lower bound we must take 



ht 
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t > 1, 



or equivalently 

ht = Zf + -^^{Y, - A,zf), t > 1, 
where is the solution of equation ([8]), which means that 



and hence 

t 



1=1 1=1 

Thus h is the unique solution of equation Finally for h the lower bound 
is attained. 

Remark 5. 1. It is worth emphasizing that the process = — 7^ — 

is the solution of the following recursive equation: 



Zt = - E ^(^' ^) rTf^(^' - + E ^(^' ^)MYi - MZ^\ (19) 
1=1 ' 1=1 

and hence the equality ht = Z^ implies immediately the equation ([8]) 
for h. This process Z^ also has a probabilistic interpretation as well as 

7t = ^ _[_^2— • -^^^'^ interpretation will be given in Sectionl^ 

2.2 Solution of the auxiliary filtering problems 

Here, for an arbitrary Gaussian sequence X, we deal with the one-step predic- 
tion and filtering problems of the signals X and ^ given by (IT^ respectively 
from the observation of F = {Y,Y^) defined in ([T]) and (IT^ . Actually, we 
follow the ideas proposed in our paper [9J. Recall that the solutions can be 
reduced to equations for the conditional moments. The following statement 
provides the equations for the characteristics which give the solution of the 
prediction problem and the equation for the other quantity Wt-i^Xt) —l^S^) 
appearing in Proposition [2] for /i = — 1. 
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Theorem 3. The conditional mean nt^i^Xt) and the variance of the one-step 
prediction error = ]E[Xt — Tft-i{Xt)]'^ are given by the equations 



t-i 



TVt-iiXt) = mf + 



s=l 




+ Q,(F,2-g,(7f,_i(X,)-/i,)], t>l, (20) 



lt = l{t,t), t>l. 



(21) 



where 7 = (7(t, s), 1 < s < t) is the unique solution of equation More- 
over, with 7^^(t) defined by ((77| j, the difference Wt-i{Xt) — l^^it) is the 
solution of equation 

Proof Note that since ht G yt and the joint distribution of {XriYs^Y^ + 
Qshg) for any r , s is Gaussian, we can apply the Note following Theorem 
13.1 in [13]. For any k < t we can write 



TikiXt) = 7ik^i{Xt) + [cov(Xt, z/fc)]'var(z/fe) V^, 
7fo(Xi) = nit, 



(22) 



where 



Yk - E{Yk/yk-i) 




Yk - AkHk-iiXk) 

+ Qkhk — QkT^k-l{Xk) 



is the innovation with covariance matrices 





and 




(24) 



with 



7(t, k) = E(Xi - 7f,_i(X0)(X, - 7ffc_i(Xfc)) . 



(25) 
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By the definition fl25l) . we see for k = t tliat tlie variance 7^ is given by (12 ip . 
Now, equality implies 

k 

WkiXt) =mt + ^l{t, I) [Ai Qi) (var z7;)"^z7i = 
1=1 

+ <3.(n'-<3.(5f.-i(^.) -M. (26) 

and putting k = t — 1 we get nothing but equation fl2U]) . Concerning the 
solution of the one-step prediction problem, it just remains to show that the 
covariance 7(t, s) satisfies equation (jl]). 
Let us define 

Sxit,l) = Xt-WiiXt). 
According to ( l22i) we can write 

Sxit, I) = 6xit, / - 1) - 7(t, /) ( A; ) {varViy%, 

and so 



E5x(ti, /)5x(t2, = ESxih, I - l)Sx{t2, 1 - 1)- 

-7(t.07(t./)(^;)'var(..)-(^;), 

or 

ESx{t\l)5x{tM) = mxit\0)5x{t',0)- 

Taking = t = s ,1 = s — \ in (!27j) . it is readily seen that equation (j4]) 
holds for 7(t, s). 

Now we analyze the difference Tft-i{Xt) ~7jfj(^)- Using the representation 
= ^l=i{^s — hs)Yg we can rewrite Wt-i{^t-i) in the following form 
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t-1 

7ft_i(6-i) = $^(7r*-i(x,)-/i,)y/, 



s=l 

which imphes that 



So we have 

t-i 

s=l 

t-1 t-1 
= 5^E(X, - 7f,_i(X,))(X, - 7f,_i(X,))r/ = 5^7(^,s)n', (28) 

s=l s=l 

where 

7(t,s) =E(X,-7fi_i(X,))(Xi-7fi_i(Xi)) =7(s,t). (29) 
Using the definitions fl25|) and fl29|) we can write 

7(t,s) -7(t, s) = -EXt{Wt-i{X,) -Ws-i{X,)). 

Again, applying the Note following Theorem 13.1 in [131, "^^^ write 
also 

WiiXr) = Wi^iiXr) + 7(t, i^i Qi) iyaTVi)-%. 
This means that 

t-1 

7Tt-i{Xr) - vr,_i(X,) = 5]]7(^, i^i Qi) (var z7,)-iz7, , 

l=r 

or equivalently 

t-1 

7rt_i(X,) - 7r,_i(X,) = 5]]7(^,^) ( ^/ ) (var z7;)-i77, . 

l=r 
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Then, multiplying by Xj and taking expectations in both sides, we get 



t-i 



W.Xt{nt-i{Xr) - 7r,_i(X,)) = ^7(^,0 { Ai Qi) (vaiVi)-^ cov{Xt,Vi) 

l=r 

Hence we have proved the following relation 



l=s 



+ (A' + QiH 



Now we can show that the difference Z^^ = nt-i{Xt) — Ij^^it) satisfies the 
equation ([8]). Using (!26|) and (128|) . we can write 



= nit + J2^{t, I) {A Qi) (var77,)-il7, -J2^{t, s)Y, 

An{t, I) 



1=1 s=l 



, ^ AqjtJ) ^. , ^ 7(f.i) 



Z=l 

t-1 
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Now we can rewrite the last term in fl31l) using the equahty (1301) . We have 



i-1 



i-1 



«=1 r=l 



i-1 



r=l 



r-1 



1=1 



t-1 



1 + {Ai + g,)7, 

, A? + Qr 



r=l 



where in the last step we have used equality (EH 
Finally ([SlD-dM]) imply: 



i-1 



i-1 



Qn{t, I) 



-hr 



i-1 



1=1 

i-1 



+ (A + Qin 



^i7(i, 



i-1 



Qn{t,i) 



—hi- 



(32) 



^ - 1 + (A2 + g,)7^ Z-.i + (Af + Qi)-fi 
which is nothing else but equation ([8]) with fi = —1. 



3 Particular cases and applications 

Here we deal with some specific cases where the results can be further elabo- 
rated. For two examples we can apply directly Theorem [1] and moreover the 
special structure of the covariances allows to simplify the answer. 
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3.1 LEG filtering of Gauss-Markov sequences 

In this part we concentrate on the case of a Gaussian AR(1) process X, i.e., 
a Gauss-Markov process driven by 

Xt = atXt^i + D^et ,t>l; Xq = x , (33) 

where {et, t = 1,2,...) is a sequence of i.i.d. standard Gaussian random 
variables and {Dt, t > 1) is a (deterministic) sequence of real numbers such 
that Dt > for t > 1. In this setting, it is easy to check that the mean and 
covariance functions of X are given by 

t t 
m = [Y\ au\x = Atx ; K{t, s) = [ Y\_ (^u]ks = -j^h , 1 < s < t , 

u=l u=s+l ^ 

t 

where Aj = Yl and 

u=l 

kt = afkt-i + Dt,t> 1, ko = 0. 
Suppose that the following the Riccati type equation 

% = Ds+ ,^(,2'''^"n ^- ' ^ > 1, 7o = 0, (34) 

has a unique nonnegative solution. 

From the classical filtering theory it is well-known that (for /i < ) 7^ is 
nothing but the variance of the error of the one-step prediction problem of the 
signal X given by the auxiliary observation Y defined by equations ([1]) and 

(|T2l) . Then, it is readily seen that the function 7(t, s), where 7(t, s) = -r-'Js 

is the solution of equation (jl]) and that moreover equation ([5]) for the solution 
h of the LEG filtering problem ([6]) can be reduced to the following one: 

= Y^^-^-i + rT%^*' ^ > = X, (35) 



or, equivalently: 



Alt 
1 + A^tlt ' 



ht = atht-i + ^ , l_ [Yt - atAtht-i], t > 1, ho = x. 
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Actually equation fl35p can also be obtained directly from the general filtering 
theory (for /i = — 1 and replacing Q by —fiQ)- For arbitrary {hf Eyt,t > 1) 
the Note following Theorem 13.1 in [13j gives the equation for Z'^: 

1 + 6t_i7i 

+ at7t ,/*"'- [yt-i - ^-i^f-i], t > 1, Z^ = X. 
1 + 6t_i7t 



- Z^ + Aa,Yt 



Hence, again the solution ht = , t > 1, of the LEG filtering 

1 + ^27, ' - ' 

problem is given by fl35|) . 

Let us emphasize that these equations are nothing but those given in 
Speyer et al. jl5] - 

It is interesting to note that in the case at = (i.i.d. signal) the solution of 
the LEG filtering problem is nothing else but the solution of the risk neutral 
filtering problem i.e. ht = 7it{Xt). 

3.2 LEG filtering of moving averages of order 1 

Here we consider the case of a MA(1) process, i.e, a non Markovian process 
X defined by 

Xt = et + Xit-i ; t > 1 , 

where {eo,ei, . . .) is a sequence of i.i.d. standard Gaussian variables and A 
is a real number. Of course X is centered and has the covariance function 
K{t, s) = 1 + if s = t, A if s = t — 1 and if s < t — 1. In order to solve 
equation (jlj) we can take 

7(t,s) = 0, s < t - 1 ; 7(t,t- 1) = A, t > 1, 

and 7(t, t) = 7^ where 7^ is the solution of the equation: 



All - f^Q 



provided that this equation has a unique nonnegative solution. 

Moreover equation ([5]) for the solution h of the LEG filtering problem 
can be reduced to the following one: 

ht = X^^^lYt^i - A-iht-i] + T^^Yt, t>l,ho = 0. 
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Again, it is interesting to note that for A = (i.i.d. signal) the solution 
of LEG filtering problem is nothing else but the solution of the risk neutral 
filtering problem i.e. ht = 7Tt{Xt). 



4 LEG and RS filtering problems 

Here, at first we show that actually the LEG and RS filtering problems have 
the same solution. Then we give an example which shows that in a more 
general context similar problems may have different solutions. 



4.1 Equivalence of LEG and RS filtering problems 

Let h = {hs)s>i be the solution of the LEG filtering problem ([6]) given by 
equation ([5]). For any fixed t <T, let us denote by gt : 



g, = arg minlE 

geyt 



t-i 

f,exp{^{X,-g)'Q,+ i^Y.{X,-his)fQ 




where g E yt means that (7 is a J^t-measurable variable. It follows di- 
rectly from Proposition [2] that, provided that 1 + St^i > 0, the equality 

_|_ j[^7y Yi 

Qt = — TTT^ — , t > 1 holds. Since it was noted in the proof of Theorem [T] 

1 + 4 7t 



that ht = — ; — — , t > 1, hence we have also gt = ht. It means that 



- Z^ + At^tY t 
1 + AH _ 

for t > 1 the solution h of the LEG filtering problem satisfies the following 
recursive equation: 



t-i 

= argmmE[/iexp{|(X,-<7)2g,+ ^^(X,-M.))U} / 3^*] • (36) 

s=l I 



Indeed, in the literature, the recursion fl36|) is the basic definition of the 
so-called risk-sensitive (RS) filtering problem which was introduced in [6]. 
Therefore we have also proved the following statement 

Theorem 4. Assume that the condition (C^) is satisfied. Let h = {ht)t>i he 
the unique solution of equation i.e., h is the solution of the LEG filtering 
problem ([6]). Then h is the solution of the RS filtering problem f l36|) . 
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4.2 Discrepancy between LEG and RS type filtering 
problems: an example 

Actually, we did not find in the literature any trace of the discussion about 
the relationship between the LEG filtering problem (jH]) and the RS filtering 
problem (l36|l even in a Gauss-Markov case. As a complement to our observa- 
tion that these two problems have the same solution, we propose an example 
to show that in a bit more general setting, two similar problems may have 
different solutions. 

1< s < T, 



For given positive symmetric deterministic 2x2 matrices A^, 



let us set ^t{h) = {Xtht)At 



h. 



We can define /it G J^t, t > 1 as a 



solution of a LEG type filtering problem 



h 



arg min IE 

hteyt,t>i 



(37) 



We can also define h as the solution of the following recursive equation 
{RS type filtering problem): 



t-i 



arg min E 



/xexp^$,(^) +^J]$.(/i) 




(38) 



The question which we discuss now is the following: does the equality 
h = h hold? 

As we have just proved, the answer is positive for singular matrices A, 
namely, when An = A22 = — A12 = Q. But in the general situation the 
answer may be negative. Actually it is sufficient to consider the following 
/ 2 -1 \ 

example: j)^i = l;/^ = ~l and Xt = Xt-i + Et, where 

{st, t = 1, 2, . . . ) is a sequence of i.i.d. standard Gaussian random variables. 
Even in this Markov case h ^ h. More explicitly let us introduce the new 
probability measure P : 



dF 



exp 


T 

~2 Y.Xi 

i=l 


E exp 
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One can check that with respect to P the observation model {Xf, Yt)t>i can 
be written in the following form: 

1 

Xt = atXt-i + D'^it, t>l] Xq = X, 
Yt = Xt + et, 

where {et)t>i is a sequence of i.i.d. standard Gaussian random variables 
independent of the sequence £, 

at = Dt 



1 



i + r(T,t) ' 

and r(T, ■) is the solution of the backward Riccati equation 

TiT t + V) 

r{T,t) = 1 + ^ ; ^ ^ , r(T,T) = o. 



It can be checked that 
r(T,t) = 10- 



l + r(T,t + l)' 



l-y5)A^-(l + V5)A*' (3 + 75)' 



Indeed to explain this change of the observation model it is sufficient to 
calculate the conditional characteristic function: 



'E[exp{iXXt)/ 



E 


exp 


zXXt-lEXf 


j Xt 


-1 


E 


exp 









where Xt-i is the a-field Xt-i = <^{{Xs , 1 < s < t — 1}). But it follows 
directly from the equation (19)- (20) in [H] and from flTBl) that 



E[exp(aXt)/A't_i] =exp 



iX 



i + r(T,t) 



Xt-i 



X' 



2(i + r(T,t)) 



Since the density -j^ does not depend on h, the initial LEG filtering 



problem (1371) can be rewritten as: 



h = arg min E 

hteyt,i<t<T 



exp 



1 ^ 
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Hence we can apply Theorem [T] or in particular and fl35l) . Clearly, h 
depends on T and h does not depend on T by the definition. A bit more 



explicitly we have for example for t 

7ri(Xi) 1 



1: hi 



- i + r(T,i) 



hi 



1+71 



4 



2 + r(T, r 

Yi and clearly they are different. 



Yi and obviously 



5 Information state, interpretation 

In this section we discuss the probabilistic interpretation of the ingredients 
of the "information state" which was introduced in the context of RS filter- 
ing and LEG control problems. By the definition, the "information state" 
contains all the information needed to describe the solution of the concerned 
optimization problem. In particular it takes into account the cost function 
but not only estimates of the signal and it should give the total information 
about the model states available in the measurement. 

Risk- Sensitive Filtering 

In the context of the RS filtering problem the definition of the information 
state can be found for example in [7]. It is the density At, with respect to 
the Lebesgue measure, of the non normalized random measure Ut'. 



ujt{dx) 



E 



l{Xt e dx) exp <^ ^ 5^(X, - h{s)fQ, 




(39) 



where ht Eyt.t >1 and the observation Y is defined by the equation ([T]). 
In a classical Gauss-Markov setting, an explicit representation of At can be 
obtained as the solution of some recurrence equation (see, e.g., [3]). 
We claim that for a general Gaussian signal X the density At satisfies the 
following equality: 



A/27r7t 



exp 



[x - Z 



h\2 



2^t 



t-l r 

n 



1 + Sr'Jr 



.-1/2 



X exp 



^ 1 + /l^7r 

2^^1 + 5,7. 



X 



xA^t, (40) 
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where = "^^ ^2—"^* ^'^^ solution of the equation ( fT9l) . 7* — 



7, are the solutions of equations (jlj) and (IHl) respectively and the martin- 
gale {Mt)>i is defined by fl50|) . 

Indeed, to prove fHOl) it is sufficient to write the following: 



e^^{^y{Xs-h{s)fQ 





I. ^ E[I(X, erfx) exp(-e,_i)/y,,,,i] ^ 

da; = = ■ — -hj 

E[exp(-6-i)/3^t,i-i] 

(41) 

where cr-field yt,t-i = cx{{{Y„Y^^), l<s<t, l<r<t - 1}). Again, 
conditionally Gaussian properties of the pair (X, ^) imply that 



E[l(X,Gdx)exp{-6}/yM-i] 
E[exp(-6^i)/3^t,t-i] 
1 



xexp|-^(a;-Zf)27-ij dx, (42) 

where = E[Xi/3^i,i_i] - E[(Xi - E[X,/3;i,i_i])(ei-i - 7fi_i(6-i))/3^t,i-i] and 
7t = E[(Xt - E[Xt/yt,t-i])T. Now the desired equality follows directly 
from Proposition [21 

It is worth emphasizing that (for negative n) now we know the probabilis- 
tic interpretation of the involved processes [Z'^, Z^, 7,7). Actually we have 
proved that Z^ is the difference vfj(X) — 7^^(t) and 7 is nothing but the 
covariance of the filtering error of X in view of auxiliary observations Y. 
For the pair {Z^, 7) we have the same relations but with respect to the a-field 
yt,t~i = <^{{(Xs, '^r)y l<'S<t, l<r<t — 1}). Of course, after a simple in- 
tegration of At, formula (HOj) gives Proposition 12. II and therefore the solution 
of the LEG and RS filtering problems. Let us also observe that the relations 

Z.^ = * ~^ * , 7t = '-^ — which were announced in Remark [5] follow 

from the Note following Theorem 13.1 in |13j . 

Linear Exponential Gaussian Control 

In the context of the LEG control problem for a partially observed process, 
the information state is also defined (see, e.g., [7]) as the density At, with 
respect to the Lebesgue measure, of the non normalized random measure 00^: 

ujt{dx) = E l{Xt e dx) exp j ^ ^ X^Q, [> / 3^t , (43) 
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where X is the controlled state governed by the equation: 

Xt = atXt-i + htUt + et, t>l \ Xq = , 



(44) 



{et)t>i is a sequence of i.i.d. standard Gaussian variables and Ut G yt-i 
corresponding to the available observation Y defined by the equation ([1]). 
By the same way that we have just explained, for the conditionally Gaussian 
pair (X, F), one can check that the density \t satisfies the following equality: 



Xt{x) 



where 7^ 




X exp 



X X Mt, (45) 



7 is the solutions of equation (jl]), the martingale {M.t) 



is defined by ( l50l) and Z is the solution of the equation 



>i 



Zt 



at 



1 + 5t7i 



1 + Sat 



Ut + 7tA>"t- 



(46) 



Actually it is the equation for the difference Z = 7!-t,t-i{X) — ■yx^(t,t — 1), 
where the conditional expectations are taken with respect to the auxiliary 
observation process Y defined by the equations ([1]) and (fT2|) with h = 0. 
Equality (H5l) gives the possibility to rewrite the cost function in terms of the 
completely observable process Z, namely: 



E[exp{|5^X,^Q. 

s=l 



E<^E 



exp 



n 

r=l 



1 + 5,% 



1 + ^27^ 



-1/2 



2 



s=l 



t-1 



n 



r=l 



1 + 5*^7^ 
1 + ^27^ 



E 

-1/2 



exp 
E 



s=l 




T 



exp 



s=l 



where Qr 



1 + A^^ 

Qr and E stands for an expectation with respect to the 



^1 + ^.7 
new measure P such that: 
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With respect to this new measure the solution of equation (H^ can be rep- 
resented as 

= at Zt-i + bt ut + Eu 47 

1 + 1 + Sa^ 1 + A^7^ 

where {et)t>\ is a new sequence of i.i.d. standard Gaussian variables. Thus, 
the new process Z plays the role of the completely observed controlled state 
(see d] and 0). 

Now we emphasize that the probabilistic interpretation of the "informa- 
tion state" used in [7] is nothing but Zt = frt^t-iiX) — •jx^it), where the 
conditional expectations are taken with respect to the auxiliary observation 
process Y defined by the equations ([H) and ( fT2l) with h = 0. Also, 7 is the 
conditional covariance of X. 



6 Complementary part - More general case 

In this section we analyze LEG and RS filtering problems in a more gen- 
eral contexts when we do not suppose a special structure of the observation 
sequence (Yt)t>i- We suppose only that the process {Xt, Yt)t>i is Gaussian 
(even conditionally Gaussian). Our goal is to reduce LEG (RS) filtering 
problems to an auxiliary risk-neutral filtering problem. First of all we fix 
/i = — 1 and we will find the probabilistic interpretation of the solution. Af- 
ter to find the solution for /i 7^ — 1 we shall have only to replace Q by —/iQ 
in the answer. So, let (Y^, ^t) be defined by equations (fT2!) - f|T3l) and let us 
denote by 

= nXt/yt,t-i] - E[(Xt - E[Xt/yt,t-i]m-i - rct-i{Ct-i))/yt,t-i], (48) 

7t = niXt - nXt/yt,t-i])?, (49) 

where y^-i is the a-field yn-i = a{{{Ys,Y^^), l<s<t,l<r<t- 

f 1' * 1 
1}). Again, let Jt = exp < — ^^(X^ — hg^Qs \ and let us denote by 2t the 

conditional expectation It = ntiJt), or 
It = E ^exp 

where hg G 3^^, s > 1. We claim the following generalization of Proposition [2J 
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Proposition 5. The following equality holds for any T > 1: 

T 



t=i 



1 Qt 



2 1 + Qtlt 



X 



where (A^t)t>i is a martingale defined by : 

1/2 



Mt 

where 



n 



t=i 



exp 



^ m-vr,-im))^-^(r,-\4)^[>, (50) 



2a! 



al = E{Yt - 'Kt-i{Yt))\ = E{Yt - Tit-i{Yt))\ 

Proof To prove Proposition [5] let us again calculate the ratio 

It-i nt-i{Jt-i) nt{Jt-i) nt-i{Jt-i) 
MJt) Mt 



nt{Jt-i) Mt-i 



with a martingale Ait such that: 



Mt = ll 



7ls{Js-l) 



(51) 



\ 7r5_i(J, 

The same arguments that we used in the proof of Proposition [2] show that 
MJt) _ nt,t-i{exp{~lQtiXt - htf - 6-i}) 



7rt(Jt-i) 

(i + gn(t))~'/'exp 



7rj,t_i(exp(-^i_i)) 
1 Qt 



{Z[' - ht 



2 l + Qtl{t) 

To finish the proof we turn to the representation of the martingale M.t defined 
by flSTl) . First of all we claim that 



Mt %-MYtedy)) 



Mt-i nt^MYtedy)) 
27 



(52) 



y=Yt 



where vr stands for the conditional expectation with respect to the measure 
~ (iP 

P such that - — = M.T- Indeed, it is the direct consequence of the classical 
aP 

Bayes formula 

To finish the proof it is sufficient to note that representations (l5Ti) and (152|) 
imply that 



Mt 



t-l. 



T^t-MYt dy)) 



M 



t-i 



t-l, 



Tit-i{m e dy)) 



-Kt-MYt e dy)'Kt{Jt-i)) 



y=Yt 



Tit-M-i)T^t-MYt G dy)) 



y=yt 



nt^,(I{Ytedy)Jt-i) 



nt-iiJt-i)nt-iiIiYt G dy)) 



y=Yt 



Again, we can use the same arguments that we used in the proof of Propo- 
sition [2) 

7it-i{IiYt G dy)Jt-i) 7fi_i(I(Ft G dy) exp{-^t-i}) 



7ri_i(Ji_i) 



7ri_i(exp{-^t_i}) 



7^2 



exp 



{Yt - Vt] 
2a2 



A direct consequence of Proposition [5] is the following statement: 

Corollary 6. Let h he the solution of LEG (and RS) filtering problem 
(and fl36|) ). Then the following equality holds for any t > 1: 



ht = Zl 



7 Particular cases - again 
7.1 Markov type observations 

Here we turn to the case when the observations (lt)i>i are conditionally in- 
dependent given X. More precisely, we deal with a signal-observation model 
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{Xt,Yt)t>i, where the signal X = (X()j>i, Xf G M" is an arbitrary Gaus- 
sian sequence with mean vector m = {mt,t > 1) and covariance matrix 
K = {K{t,s),t> l,s > 1), z.e., 

lEXt = mt, E(Xt - mt){Xs - m,)' = K{t, s) .t > 1 , s > 1 , 

The observation process Y = (Yt, t > 1) is given by 

Yt = AtXt + et, (53) 

for some sequence A = {At, t > 1) of m x n matrices, where e = {et)t>i is a 
sequence of i.i.d. Af{0,ld) random variables and e and X are independent. 
In this case we can write the multidimensional analogue of the equation (fTOll . 
which is nothing else but the dynamic equation for the process defined 
by (HHD- We obtain: 

t-i t 

1=1 1=1 

where the matrix ^{t, I) satisfies the following equation (which is the multi- 
dimensional analog of the equation (jlj)): 

s-l 

7(t, s) = K{t, s) - Y^^it, l)A[[Id + AaiAr'A'n'is, I), (54) 



1=1 



where Ai 



Ai 

Now the solution of the LEG (and RS) filtering problem h is nothing else 
but: 



t 



ht = mt + ^7(i, l)A'i(Yi - Aihi). 
1=1 

7.2 Markov type observations, correlated signal and 
observation noises 



Let us drop the assumption that X and e in the observation equation (l53i) 
are independent. Denote by K^^{t, s) the covariance matrix of the signal and 
the observation noise, i.e., 

E{Xt-mt)e', = K^^{t,s), t > 1 , s > 1. 
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It can be checked that the following slight modification of the previous state- 
ment holds. 

Let the matrix j{t, I) be the unique solution of the following equation 



s-l 



7(t, s) = K{t, s) - Y^m, l)A\ + K,^ {t, I)] 



1=1 

[Id + Aa,A\ + AK^^ii, I) + K^^ii, lyAr' 

[A'n\sJ)+K',SsJ)l (55) 
with Ai=(^ ^ , K.^it, I) = {K,St. I) 0). 

Then the solution of the LEG (and RS) filtering problem h satisfies the 
following equation 

t 

ht = mt + J2i^xAt, I) + 7(t, 0^;] [Id + AiK^Xl^ 0]"'(>^ - ^ihi)- (56) 

1=1 

7.3 Observations containing Moving Averages of or- 
der 1 

Now we consider the case of a MA(1) type process, i.e., the following signal- 
observation model: 

Xt = et + Xst^i ; t > 1 , 

Yt = atXt + et + f3et-i ; t > 1 , 

where {et,et)t>o is a sequence of i.i.d. Gaussian variables and A and P are 
real numbers. 

Let us denote by At the row At = [at (3) and by Xt the vector Xt = 
Xt 



. Of course X is centered, has the covariance matrix Kit, s) 

l{s = t) 



l{s = t-l] 



X and e is K^^(t, s 



The solution 7 to fl55|) then can be found as: 





7(t,s) = 0, s<t-l- 7(t,t-l)= ( ^ ° ) , t>l 
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and ■y(t,t) = 7^ where 7^ is the solution of the equation: 



7. = 1 1 ) + 



+ 



Xat-i -XfiQt-i 
1 



provided that this equation has the unique nonnegative definite solution. 

Moreover, equation ( l56l) for the solution h of the LEG filtering problem 
([6]) can be reduced to the following one: 

ht = ( 1^"*^ ) [Yt-i - + K'lt ( ^* ) t > 1, h = 0, 

with At = Id + %A[At. 

7.4 Observations containing Gaussian AR(1) process 

In this part we concentrate on the case of a Gaussian AR(1) type process Y, 
i.e., 

Yt = atXt + et, t>l; Yq = , (57) 

where 

et = +et, 

and {st, t = 1,2,...) is a sequence of i.i.d. standard Gaussian random 
variables independent of X. We also suppose that the signal X is a Gaussian 
AR(1) process, i.e., 

Yt = atXt + et, t>l; Xq = , (58) 

and also {et, t = 1, 2, . . . ) is a sequence of i.i.d. standard Gaussian random 
variables. Proceeding as in Sections 13.11 and 17.31 we can write the dynamic 
equation for the solution of LEG and RS filtering problems h. Namely, h is 
the first component of the solution of the following recursive equation: 

= 7,A;[ri-AA]+(^ ^7^^_,+ |^ ^ [v;_i-A-iVi]t> 1,7^0 = 0, 
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where At — {at P) and 7 is the unique nonnegative defined solution of the 
Ricatti equation: 



It 



at 
h 



7t-i 



at 
h 



at 
h 



at 
h 





1 



1 





at b 

with^= I -fxQt 
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